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This  article  describes  issues  affecting  the  design  of  lessons-learned  systems 
for  defense  acquisition  organizations.  It  draws  both  on  studies  of  existing  lessons 
learned  systems  and  the  literature  of  organizational  learning  and  knowledge 
management.  The  exploration  of  these  issues  suggests  that  attention  to  social 
processes  within  organizations  is  as  important,  if  not  more  so,  as  the 
development  of  information  technology  processes  in  the  success  of  lessons- 
learned  systems.  The  article’s  conclusions  can  assist  in  the  determination  of 
appropriate  requirements  and  resources  for  an  acquisition  lessons-learned 
system. 


Though  the  idea  of  learning  from  ex¬ 
perience  is  timeless,  formalized  sys¬ 
tems  for  capturing  and  disseminat¬ 
ing  lessons  within  organizations  have 
received  increased  attention  in  recent 
years.  Interest  in  such  lessons-learned 
systems  (LLSs)  has  grown  through  the 
popularization  of  concepts  such  as  the 
“learning  organization”  (Senge,  1990), 
through  developments  in  knowledge  man¬ 
agement  (Davenport  &  Prusak,  1998; 
Nonaka,  1991),  and  through  information 
technology  advances  that  hold  out  the 
promise  of  wider,  more  efficient  distribu¬ 
tion  of  lessons  within  an  organization.  This 
growth  is  especially  evident  in  the  private 
sector,  where  a  firm’s  learning  capahili- 
ties  and  knowledge  are  viewed  as  strategic 


resources  that  give  it  a  competitive  edge 
(Davenport,  1997a;  Zack,  1999a). 

Amid  this  growing  interest,  a  variety  of 
forms  of  LLS  have  emerged,  from  static 
database  collections  of  lessons  (U.S. 
Army,  1997),  to  “groupware”  tools  (e.g., 
Lotus  Notes)  for  electronic  collaboration 
(Davenport,  1997c),  to  heuristics-driven 
expert  or  “intelligent”  systems  (Aha, 
2000).  Yet,  as  Zack  (1999b)  notes,  very 
little  research  has  been  done  regarding  the 
most  appropriate  LLS  form  for  a  particu¬ 
lar  organization.  With  an  inadequate  under¬ 
standing  of  design  issues  and  alternatives, 
leaders  may  implement  systems  that  fit 
their  organizations  poorly. 

Defense  acquisition  presents  particular 
challenges  for  design  of  LLSs.  Particularly 
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Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  0MB  control  number. 
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with  major  weapon  systems,  acquisition 
is  a  highly  complex  enterprise  that  encom¬ 
passes  multiple  contexts  —  those  of  poli¬ 
tics,  business,  technology,  and  the  military, 
to  name  a  few  —  and  multiple  stakehold¬ 
ers  with  often  competing  interests  (Mayer, 
1991 ;  McNaugher  1989).  Its  processes  are 
idiosyncratic  (i.e.,  different  parties  impro¬ 
vise  different  solutions  to  unique  chal¬ 
lenges)  and  contextual  (i.e.,  different 
projects  pose  different  kinds  of  chal¬ 
lenges).  Acquisition  also  has  a  highly  in¬ 
terdisciplinary  character  in  that  it  entails 
the  integration  of  a  hroad  range  of  techni¬ 
cal  and  management  skills,  including  con¬ 
tracting,  system  engineering,  finance,  and 

many  others 
(Fox,  1988). 
Thus,  success¬ 
ful  acquisition 
professionals 
may  he  viewed 
as  knowledge 
specialists,  in 
that  they  have 
unique  experi¬ 
ences  in  solv¬ 
ing  specialized 
kinds  of  problems.  They  master  a  com¬ 
plex  kind  of  knowledge  in  which  they 
improvise  solutions  to  challenges  for 
which  procedural  knowledge  offers 
limited  guidance.  How  might  such  knowl¬ 
edge  be  transferred  to  others  in  defense 
acquisition? 

This  article  focuses  on  two  questions 
to  address  this  issue: 

•  What  design  aspects  and  issues  are  in¬ 
dicated  by  analysis  of  existing  LLSs? 

•  What  do  organizational  learning  and 
knowledge  management  concepts 


suggest  are  key  aspects  of  LLS  design 

for  acquisition  organizations? 

This  article  begins  with  an  overview  of 
organizational  learning  concepts  to  estab¬ 
lish  the  intended  benefits  of  LLSs.  It  then 
describes  operation  and  characteristics  of 
LLSs  to  develop  a  set  of  factors  and  issues 
to  be  considered  in  design.  Next,  it  turns 
to  the  literature  of  organizational  learning, 
communications,  and  knowledge  manage¬ 
ment  to  describe  issues  relating  to  how 
organizations  learn  and  how  they  transfer 
knowledge  among  their  members.  The 
article  concludes  with  some  specific  im¬ 
plications  for  LLSs  in  acquisition  organi¬ 
zations.  Although  the  discussion  focuses 
on  defense  acquisition,  the  conclusions 
extend  to  lessons  learned  and  knowledge 
management  systems  in  other  areas  as 
well. 

LLS 


The  term  lessons-leamed  system  in  this 
article  refers  to  the  activities,  people,  and 
products  that  support  the  recording,  col¬ 
lection,  and  dissemination  of  lessons 
learned  in  organizations.  These  systems 
may  focus  on  “negative”  lessons  of  fail¬ 
ures,  deficiencies,  and  other  problems  to 
be  avoided,  or  on  “positive”  lessons  of 
innovative  techniques  and  “best  practices” 
to  be  emulated.  Definitions  of  lessons 
learned  vary.  Although  the  Army  defines 
them  as  “validated  knowledge  and  expe¬ 
rience  derived  from  observations  and  his¬ 
torical  study  of  military  training,  exercises, 
and  combat  operations”  (U.S.  Army,  1997, 
p.  1),  in  the  Marine  Corps  they  are  “pro¬ 
cedures  developed  to  ‘work  around’  short¬ 
falls  in  doctrine,  organization,  equipment. 


"The  term  lessons- 
learned  system... 
refers  to  the  activi¬ 
ties,  peepie,  and 
products  that  sup¬ 
port  the  recording, 
ceiiectien,  and 
dissemination  of 
iessens  iearned  in 
organizations." 
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training  and  education,  and  facilities  and 
support”  (U.S.  Marine  Corps,  1994).  Most 
systems  in  current  use  are  web-based. 

Intended  Benefits  - 
Organizational  Learning 

Organizational  learning  (Argytis,  1999) 
is  usually  defined  in  terms  of  members 
learning  from  each  other,  that  is,  when 
members  share  “theories  of  action” 
(Argytis  &  Schon,  1978)  or  “mental  mod¬ 
els”  (Senge,  1990).  Lipshitz,  Popper,  and 
Oz  (1996)  take  a  structural  approach  by 
focusing  on  organizational  mechanisms 
that  facilitate,  make  explicit,  or  routinize 
such  sharing.  These  mechanisms  are  the 
“institutionalized  structural  and  procedural 
arrangements  that  allow  organizations  to 
systematically  collect,  analyze,  store,  dis¬ 
seminate,  and  use  information  that  is  rel¬ 
evant  to  the  effectiveness  of  the  organiza¬ 
tion”  (p.  293).  Such  mechanisms  include 
organization  histories,  project  reports, 
after-action  reviews  (Busby,  1999)  and 
more  generally,  LLSs.  These  mechanisms 
are  intended  to  allow  an  individual’s  learn¬ 
ing  to  become  recorded  in  an  organiza¬ 
tion’s  documents,  processes,  and  other 
“memory”  media  in  such  a  way  that  other 
members  may  learn  from  it,  thereby  con¬ 
tributing  to  improved  effectiveness  or 
facilitating  an  organization’s  adaptation  to 
a  changing  environment  (Argote  &  Mc¬ 
Grath,  1993;  Myers,  1996).  Many  see  the 
idea  of  a  learning  organization  as  inextri¬ 
cably  tied  to  an  organizational  culture  that 
reflects  such  sharing  through  honest  and 
open  communication  (Cook  &  Yanow, 
1993;  Schein,  1985). 

Center  for  Army  Lessons  Learned 

One  of  the  earliest  and  best-known 
LLSs  is  the  Center  for  Army  Lessons 


Learned  (CALL)  at  Fort  Leavenworth,  KS, 
established  in  1985  for  the  purpose  of  col¬ 
lecting  lessons  learned  during  simulated 
combat  training  exercises  (U.S.  Army, 
1 997).  Over  the  years,  CALL’S  mission  has 
expanded  to  encompass  lessons  from 
actual  combat  and  other  military  opera¬ 
tions  (e.g.,  JUST  CAUSE  in  1989).  CALL 
also  employs  dedicated  expert  observer 
teams  to  collect  lessons  from  selected 
high-priority  operations.  CALL  is  staffed 
with  resources  necessary  to  accomplish  a 
variety  of  lessons-learned  functions,  in¬ 
cluding  collection;  analysis;  processing; 
dissemination; 
archiving;  and 
research.  It  pub¬ 
lishes  tailored 
lessons-learned 
products  in  a 
wide  variety  of 
media,  includ¬ 
ing  newsletters,  handbooks,  bulletins,  and 
the  Internet  (including  both  secure  and 
public  on-line  databases). 

LLS  Characteristics 

Zack  (1999a,  pp.  48-49)  describes  the 
general  sequence  of  operation  of  LLSs: 
generation,  submission,  processing,  and 
dissemination.  Specific  aspects  of  design 
and  operation  vary  widely.  Table  I  adapts 
Aha’s  (2000)  characterization,  developed 
from  an  analysis  of  existing  LLSs,  to 
group  system  characteristics  under  lesson, 
operational,  and  organizational  factors. 

Lesson  factors  describe  the  “product” 
of  the  system,  that  is,  whether  it  produces 
lessons  only  (pure)  or  includes  other  prod¬ 
ucts  such  as  best  practices  or  information 
updates  (hybrid).  The  other  lesson  factor 
describes  the  type(s)  of  processes  ad¬ 
dressed  by  the  lesson  or  other  product. 


"Organizational 
learning  is  usually 
defined  in  terms  of 
members  learning 
from  each  ether  •••• 
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Table  I. 

Lessens  Learned  System  Charaeteristies  (adapted  item  Aha,  2000) 


Lesson 

Content 

Pure 

Hybrid 

Process  type 

Technical 

Administrative 

Planning 

Operational 

Access 

Open 

Closed 

Formality 

Formal 

Ad  hoc 

Locus 

Centralized 

Distributed 

Process  relation 

Embedded 

Standalone 

Acquisition 

Active 

Passive 

Handling 

Rigorous 

Open 

Dissemination 

Active 

Passive 

Organizational 

Interpretive  context 

High 

Medium 

Lew 

Type 

Adaptable 

Rigid 

Technical  processes  usually  deal  with 
scientific,  engineering,  or  other  highly 
technical  matters.  Administrative  pro¬ 
cesses  usually  involve  fairly  routine  pro¬ 
cedures  or  decisions  made  hy  a  single 
individual,  for  example,  a  purchasing 
specialist.  Planning  processes  entail  more 
complex  and  strategic  matters  involving 
multiple  stakeholders.  CALL,  for  ex¬ 
ample,  focuses  mainly  on  “tactics,  tech¬ 
niques,  and  procedures”  for  operational 
forces  rather  than  on  “macro-issues”  or 
strategic  operations;  hence,  its  processes 
would  he  classified  as  “technical.” 

Operational  factors  descrihe  how  LLSs 
function.  Access  refers  to  the  extent  to 
which  those  outside  an  organization  may 
use  its  system.  Open  systems  may  he 
accessihle  to  the  general  public,  whereas 
closed  systems  have  security  features  that 
limit  their  use  to  members  of  the  organi¬ 
zation.  Formal  systems  have  established 
procedures  and  processes  of  operation, 
such  as  those  described  for  CALL.  The 
U.S.  Geological  Survey  has  taken  a  more 
informal  approach  in  generating  lessons 


that  are  based  on  analysis  and  synthesis 
of  the  findings  of  more  than  250  scientific 
studies  of  the  environment  (U.S.  Geologi¬ 
cal  Survey,  1995).  These  assist  local  natu¬ 
ral  resource  managers  in  policy  making 
and  decision  making.  Another  example  of 
an  informal  system  was  the  Navy  Acqui¬ 
sition  Reform  Office’s  (ARO)  recent 
Change  Through  Ex-Change  Initiative. 
Every  three  months,  ARO  solicited  acqui¬ 
sition  organizations  to  provide  two  ap¬ 
proaches,  ideas,  process  innovations,  or 
lessons  learned,  which  were  distributed  via 
diskette  and  posted  on  the  ARO  web  site 
(U.S.  Navy,  1999). 

CAEE  is  an  example  of  a  centralized 
EES  that  serves  the  Army  worldwide  from 
its  offices  at  Eort  Eeavenworth,  KS.  The 
Department  of  Energy  (DoE)  operates  a 
distributed  system  with  a  networked  in¬ 
frastructure  of  systems  and  lessons- 
learned  “coordinators”  at  various  sites  and 
contractor  facilities.  EESs  are  embedded 
if  they  operate  in  an  integrated  fashion 
during  other  organizational  activities,  as 
in  the  case  of  Army  units  conducting  after- 
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action  reviews  in  the  course  of  training 
exercises  (Baird,  Holland,  &  Deacon, 
1999).  Embedded  systems  usually  feature 
active  acquisition  and  dissemination 
(“pull”  and  “push”)  of  lessons,  whereas 
standalone  systems  “wait”  for  user  input 
and  retrieval  of  lessons.  The  U.S.  Marine 
Corps  Lessons-Learned  System  (MCLLS) 
relies  heavily  on  decentralized  reporting 
(i.e.,  passive  acquisition)  from  unit  after¬ 
action  reports  of  exercises  and  operations. 

Handling  refers  to  the  level  of  treatment 
given  a  lesson  after  it  has  been  generated. 
Rigorous  handling  implies  significant  con¬ 
trol  through  some  review  and  approval 
process,  whereas  open  handling  implies 
little  or  no  control  of  lessons.  Lundamen- 
tally,  handling  involves  decisions  as  to 
whether  one  individual’s  learning,  as  re¬ 
flected  in  the  lesson,  should  be  shared  with 
others. 

Questions  that  arise  here  may  include: 
Does  the  information  in  the  lesson  need 
to  be  verified,  substantiated,  or  validated? 
Is  additional  information  or  discussion 
necessary  to  make  it  understandable  to 
others?  Does  it  sufficiently  describe  con¬ 
text  and  circumstances  so  that  other  mem¬ 
bers  of  the  organization  can  judge  the 
lesson’s  relevance  under  differing  condi¬ 
tions?  Is  it  consistent  with  organizational 
goals  and  policies? 

Lor  example,  CALL  includes  in  its  pro¬ 
cess  of  lesson  development  a  coordination 
step  to  solicit  comments  from  agencies  and 
commands  that  may  be  affected  by  or  have 
interest  in  dissemination  of  a  lesson.  The 
MCLLS  features  a  process  of  lessons- 
leamed  reviews  by  various  working  groups 
and  committees,  which  assign  responsibil¬ 
ities  for  analysis,  action,  and  disposition. 
DoE  lessons-learned  coordinators,  among 
their  other  duties,  perform  a  validation 


function  before  a  lesson  is  submitted  for 
publication. 

Two  organizational  factors  may  be  con¬ 
sidered  when  determining  how  handling 
should  occur.  Interpretive  context  (Zack, 
1999a,  p.  50)  refers  to  the  extent  to  which 
members  of  an  organization  share  similar 
knowledge,  backgrounds,  and  experi¬ 
ences.  In  an  or¬ 
ganization  with 
a  high  interpre¬ 
tive  context, 
most  members 
are  likely  to  un¬ 
derstand  the 
content  and  sig¬ 
nificance  of  lessons  generated  by  other 
members.  Lessons  generated  in  an  orga¬ 
nization  with  a  low  interpretive  context 
may  need  to  include  more  detail  in  terms 
of  description  and  explanation,  and  may 
need  to  be  “translated”  during  handling  for 
broader  understanding. 

The  other  organizational  factor  to  be 
considered  is  how  rigid  or  adaptable  an 
organization  is  in  terms  of  changing  its 
“habits  of  action”  in  response  to  lessons 
learned  by  its  members.  An  organization 
may  have  a  culture  that  inhibits  its  ability 
to  change,  or  it  may  be  constrained  by 
laws,  professional  standards,  or  by  other 
organizations.  Such  constraints  indicate 
the  potential  need  to  review,  validate,  and 
perform  coordination  on  lessons  before 
they  are  disseminated  to  and  shared  with 
the  rest  of  the  organization. 

LLS  Issues 

Though  the  benefits  of  knowledge  man¬ 
agement  systems  are  widely  accepted, 
their  success  is  not  guaranteed.  One  of  the 
most  significant  pitfalls,  according  to  Dav¬ 
enport  (1997b),  is  the  “if  you  build  it,  they 


"Handling  refers 
to  the  level  of 
IrealmenI  given  a 
lessen  after  it  has 
been  generated." 
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will  come”  fallacy.  That  is,  merely  imple¬ 
menting  an  LLS  does  not  ensure  that  mem¬ 
bers  of  an  organization  will  use  it,  either 
to  generate  lessons  or  to  seek  out  those 
learned  hy  others.  Reasons  for  such  lack 
of  use  are  usually  attrihutahle  to  issues  of 
motivation  or  organizational  culture.  In¬ 
dividuals  may  simply  not  have  time  to 
generate  lessons  after  a  learning  experi¬ 
ence,  or  perhaps  they  feel  unwilling  to 

acknowledge 
that  problems 
have  occurred. 
Some  who  are 
facing  new  sit¬ 
uations  may  be 
unwilling  to 
seek  out  les¬ 
sons  learned 
by  others  if 
they  feel  their  problem  is  unique  and  not 
amenable  to  solution  by  past  methods. 
Such  participation  issues  may  be  ad¬ 
dressed  through  a  “championing”  of  the 
system  by  the  organization’s  leaders  or 
through  rewards  and  incentives  designed 
to  institutionalize  use  of  the  system 
(Fulmer,  1999). 

The  effectiveness  of  an  LLS  might  also 
be  affected  by  the  substance  of  lessons, 
particularly  if  handling  is  not  rigorous.  In¬ 
dividuals  may  generate  lessons  contain¬ 
ing  problematic  information  such  as  un¬ 
substantiated  opinions,  controversial  find¬ 
ings,  or  self-serving  claims,  to  name  but  a 
few.  They  may  be  poorly  written,  perhaps 
with  little  background  or  context  that 
would  allow  others  to  judge  the  wider  ap¬ 
plication,  or  with  too  much  detail  that 
bores  or  confuses  readers.  Such  problems 
point  out  the  need  for  some  degree  of  rigor 
in  handling. 


Clearly,  too  much  rigor  in  handling  may 
squelch  participation.  Processes  of  review, 
editing,  validation,  and  approval  may  be¬ 
come  so  burdensome  that  organizational 
members  lose  interest  in  submitting  les¬ 
sons.  This  indicates  the  need  for  LLSs  to 
include  some  feedback  mechanism  so  that 
those  involved  in  handling  can  keep 
members  apprised  of  the  status  of  their 
submissions. 

Finally,  LLSs  require  maintenance.  For 
example,  databases  need  to  be  reviewed 
for  outdated  content,  and  periodic  up¬ 
grades  may  be  needed  to  incorporate  new 
technology.  Of  course,  such  maintenance 
requires  resources,  which  means  that  LLSs 
must  “compete”  with  other  organizational 
programs  for  scarce  resources.  The  fail¬ 
ure  of  leaders  to  provide  adequate  re¬ 
sources  may  be  perceived  as  a  lack  of 
organizational  commitment,  leading  to 
low  participation  levels. 

Summary 

The  foregoing  discussion  has  illustrated 
a  range  of  alternatives  available  to  design¬ 
ers  of  LLSs.  This  range  indicates  the  need 
to  examine  several  different  factors  of  an 
organization  and  its  knowledge  needs  to 
arrive  at  a  system  design  that  fits  the 
organization  well. 

Knowledge  Transfer  in 
Defense  Acquisition 


Putnam,  Phillips,  and  Chapman  (1996) 
described  several  differing  perspectives  on 
organizational  communications  held  by 
managers  and  theorists.  Probably  the  most 
ubiquitous  of  these  is  the  conduit  per¬ 
spective  (Axley,  1984),  in  which  com¬ 
munications  are  thought  of  as  objects  or 


"The  effectiveness 
of  an  LLS  might 
aise  he  affected  hy 
the  substance  of 
iessens,  particuiariy 
if  handiing  is  net 
rigorous." 
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transmissions  that  flow  through  organiza¬ 
tional  channels  from  a  source  to  a  receiver. 
Such  a  view  is  often  reflected  in  a  mana¬ 
gerial  emphasis  on  communications  tools 
(e.g.,  information  systems)  and  techniques 
to  enhance  the  speed,  efficiency,  and 
accuracy  of  knowledge  flow  within  an 
organization  (Eisenherg  &  Phillips,  1991). 
Against  the  conduit  view  is  the  idea  of 
knowledge  as  socially  constmcted  (Berger 
&  Luckman,  1967),  or  put  another  way, 
as  the  product  of  interpersonal  relation¬ 
ships.  This  constructivist  perspective 
emphasizes  social  processes  that  lead  to 
knowledge  creation  and  sharing  (Putnam 
et  ah,  1996).  Giddens’  (1979)  theory  of 
structuration  —  the  production  and  repro¬ 
duction  of  social  systems  through  mem¬ 
bers  ’  interactions  —  has  been  particularly 
influential  (Orlikowski,  1992;  Poole  & 
DeSanctis,  1990).  For  example,  Orli¬ 
kowski  and  Yates  (1994)  describe  how, 
over  time,  a  distributed  group  of  knowl¬ 
edge  workers  produced  a  rich,  varied,  and 
changing  structure  (“genres”)  of  commu¬ 
nicative  practices.  From  such  a  view, 
“organizing”  is  not  a  one-time  event,  but 
rather  a  continual  process  carried  out 
through  the  social  interactions  of  members 
(Weick,  1979). 

Recognizing  this  distinction  has  pro¬ 
found  implications  for  the  design  of  FFSs. 
From  the  conduit  perspective,  one  may 
design  a  system  to  emphasize  the  ease  of 
lesson  input  and  extraction  by  organiza¬ 
tion  members,  whereas  from  the  construc¬ 
tivist  view,  one  may  focus  instead  on  the 
texture  and  development  of  interpersonal 
relationships  within  an  organization.  The 
following  sections  draw  on  research  from 
several  fields  —  organizational  learning, 
knowledge  management,  and  organiza¬ 
tional  communications  —  to  explore  such 


issues  in  greater  detail.  This  is  not  intended 
to  be  a  comprehensive  synthesis  of  the  lit¬ 
erature,  but  rather  a  leveraging  of  selected 
research  to  shed  light  on  FFS  design 
issues. 

Knowledge  Complexity  and 
Interdependence 

Theorists  of  knowledge  management 
have  distinguished  between  different  kinds 
of  knowledge.  These  determine  the  most 
effective  method  of  transfer.  For  example, 
learning  how  to  solve  an  algebra  problem 
can  be  understood  via  the  transmission  of 
abstract  concepts.  Fearning  carpentry,  on 
the  other  hand,  involves  purposeful  activ¬ 
ity  and  experimentation,  a  kind  of  learn¬ 
ing  that  is  beyond  verbalization.  Many 
(e.g.,  Nonaka,  1991)  have  built  on  the 
work  of  Polanyi  (1966)  to  create  a  distinc¬ 
tion  and  a  continuum  between  explicit  and 
tacit  knowledge.  Knowledge  that  is  con¬ 
sidered  complex  or  difficult  to  verbalize 
or  codify  in  writing,  is  tacit  knowledge;  it 
can  be  acquired  only  through  experience. 
Tacit  knowl¬ 
edge  is  highly 
personal,  deeply 
rooted  in  action, 
and  consists  of 
mental  models, 
beliefs,  and  per¬ 
spectives  so  in¬ 
grained  that 
they  are  often  taken  for  granted  and  not 
easily  articulated  (Argyris,  1999).  Explicit 
knowledge  is  that  which  can  be  codified 
(Zack,  1999b).  It  is  acontextual  and  cor¬ 
responds  to  “banking  concepts”  of 
learning,  which  assume  that  knowledge 
can  be  transferred  from  one  party  to 
another  regardless  of  context.  Most  stud¬ 
ies  agree  that  explicit  knowledge  is  easier 
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to  transfer  than  tacit,  complex  knowledge 
(Hansen,  1999). 

Tyre  &  von  Hippel  (1997)  emphasize 
the  situated  nature  of  knowledge.  They 
claim  that  knowledge  is  not  absolute,  hut 
rather  is  dependent  on  context  and  setting. 
Actors  draw  on  codified,  abstract  theory 
in  their  local,  informal  routines,  but  they 
adapt  them  as  they  work  on  problems 
within  particular  circumstances.  Looking 
at  the  “situated”  nature  of  learning  raises 
the  issue  of  knowledge  representation. 
Organizations  may  fail  to  recognize  the 

complexity  of 
knowledge  by 
describingjobs 
in  simple,  ca¬ 
nonical  steps, 
which  inhibit 
how  managers’ 
interpret  and 
value  the  im¬ 
portance  of  noncanonical  practices.  Actual 
on-the-job  practice  requires  interpolations 
between  abstract  knowledge  and  practical, 
situated  demands. 

Orr  (1996)  points  out  the  dichotomy 
between  managers’  understanding  of  job 
requirements  and  actual  practices:  “Al¬ 
though  the  documentation  becomes  more 
prescriptive  and  ostensibly  more  simple, 
in  actuality  the  task  becomes  more  impro- 
visational  and  more  complex”  (p.  42).  This 
point  is  illustrated  in  his  study  of  Xerox’s 
training  of  service  representatives.  The 
trainers  attempted  to  document  every 
imaginable  breakdown  in  copiers,  so  that 
when  technicians  arrived  to  repair  a 
machine,  they  simply  referred  to  the 
manual  and  followed  a  predetermined 
decision  tree  to  perform  a  series  of  tests 
that  dictated  a  repair  procedure.  Trainers 
believed  that  a  diagnostic  sequence  could 


be  devised  to  respond  to  predictable  prob¬ 
lems.  However,  the  study  revealed  that  no 
amount  of  documentation  could  include 
enough  contextual  information  to  make 
every  problem  understandable.  Orr  de¬ 
scribes  a  technical  representative  confront¬ 
ing  a  machine  with  error  codes  and  mal¬ 
functions  that  were  not  congruent  with  the 
diagnostic  blueprint.  This  machine’s  mal¬ 
function  did  not  fit  the  kind  of  errors  that 
were  documented  nor  had  anything  like 
this  problem  been  covered  in  his  training. 
Both  he  and  the  technical  specialist  he 
called  in  to  help  were  baffled.  To  simply 
give  up  the  repair  effort  and  replace  the 
machine  would  have  been  a  solution,  but 
would  have  meant  loss  of  face  with  the 
customer  —  an  unacceptable  solution. 
After  exhausting  the  approaches  suggested 
by  the  diagnostic,  they  attempted  to  make 
sense  of  this  anomaly  by  connecting  it  to 
previous  experiences  and  stories  they  had 
heard  from  others’  experience.  After  a  5- 
hour  troubleshooting  session  of  trials  and 
errors,  they  developed  a  solution. 

Many  jobs  require  this  type  of  impro¬ 
visation  —  a  patching  together  of  bits  and 
pieces  of  experience  to  gain  understand¬ 
ing  of  problems  that  do  not  provide  de¬ 
finitive  solutions.  In  Orr’s  account,  the 
technicians  go  through  constructing  a 
coherent  account  of  malfunction  out  of  the 
incoherence  of  the  data  and  documenta¬ 
tion.  They  go  through  a  long  storytelling 
procedure,  talking  about  the  machine’s 
erratic  behavior,  their  memories  of  other 
technicians’  stories,  and  information  from 
users,  which  they  try  to  put  together  in  a 
composite  story.  The  process  of  forming 
the  story  actually  becomes  an  integral  part 
of  the  diagnosis  (Watzlawick,  Beavin,  & 
Jackson,  1967;  Weick,  1979).  This  process 
begins  and  ends  with  communal  under- 
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standings  that  are  not  available  from 
canonical  documents;  narration  is  an  im¬ 
portant  element  in  integrating  the  various 
facts  of  situation. 

This  suggests  the  necessity  of  informal 
interactions  between  individuals  for  com¬ 
plex  knowledge  to  be  transferred.  Mem¬ 
bers  must  engage  in  informal,  unstructured 
communications  and  processes  of  “sense¬ 
making”  (Weick,  1979);  discussion,  nego¬ 
tiation,  and  argument  are  central  to  the 
learning  process.  Daft  and  Lengel  (1984) 
addressed  the  role  of  so-called  rich  media 
(e.g.,  face-to-face  communications)  in  re¬ 
solving  uncertain  and  equivocal  situations. 
Such  studies  led  Brown  and  Duguid 
(1991)  to  identify  “communities  of  prac¬ 
tice,”  small,  informal,  collaborative  groups 
that  generate  a  common  understanding  of 
events  and  a  shared  orientation  for  acting 
in  the  future.  To  foster  learning,  they  con¬ 
tend,  organizations  must  see  beyond  con¬ 
ventional,  canonical  job  descriptions  and 
recognize  how  learning  occurs  in  the  rich 
context  of  practice. 

Relationships  Between  Learners 

According  to  Lucas  and  Ogilvie  (1999), 
group  heterogeneity  is  an  important  fac¬ 
tor  in  the  dissemination  of  knowledge. 
Homogenous  groups  usually  have  access 
to  the  same  information  and  therefore  offer 
limited  opportunities  for  learning.  Poten¬ 
tial  for  knowledge  transfer  is  increased 
when  members’  backgrounds  and  experi¬ 
ences  are  varied  and  complementary. 
However,  the  price  for  this  richer  learning 
potential  is  the  cost  of  maintaining  rela¬ 
tionships  among  individuals  who  do  not 
have  common  experiences  (e.g.,  greater 
potential  for  conflict). 

According  to  social  network  theory, 
knowledge  transfer  works  best  in  organiza¬ 


tions  with  weak  ties  (i.e.,  distant  and  infre¬ 
quent  relationships)  among  members.  Gran- 
ovetter  (1982)  claimed  that  weak  ties  are 
efficient  for  knowledge  sharing  because 
they  provide  access  to  novel  information 
by  bridging  disconnected  groups.  Strong 
ties,  on  the  other 
hand,  lead  to  re¬ 
dundant  infor¬ 
mation,  because 
members  know 
each  other  well. 

Hansen  (1999) 
argued,  how¬ 
ever,  that  net¬ 
work  theory  is 
focused  on  access  to  new  information, 
which  overlooks  the  issue  of  complex 
knowledge  transfer.  Weak  ties,  he  claimed, 
indeed  facilitate  the  processing  of  explicit 
knowledge,  but  they  slow  down  the  pro¬ 
cessing  of  complex  knowledge,  because 
there  are  fewer  interactions  for  transferring 
complex  knowledge.  “[TJransferring 
noncodified  and  dependent  knowledge  is 
less  difficult  to  the  extent  that  the  parties 
to  the  transfer  understand  each  other”  (p. 
88). 

In  a  similar  vein,  Fulk  (1993)  found  a 
positive  relationship  between  group  mem¬ 
bers  ’  technology-related  attitudes  and 
behaviors  and  their  attraction  to  their  work 
groups.  The  implications  are  significant 
regarding  productivity.  In  Hansen’s  study, 
in  which  units  were  exchanging  explicit 
knowledge,  those  with  weak  links  (i.e., 
connected  only  by  e-mail)  completed  their 
projects  25  percent  faster  than  those  with 
strong  links.  When  tacit  knowledge  was 
exchanged,  however,  units  with  weak  links 
were  at  a  disadvantage;  they  took  20 
percent  longer  to  complete  projects  than 
did  units  with  strong  links. 
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Two  Cases 

Although  many  organizations  in  the 
past  decade  have  adopted  information 
systems  in  attempts  to  enable  knowledge 
transfer,  there  are  few  empirical  studies 
that  actually  document  the  enahlers  and 
constrainers  in  these  efforts.  Most  of  the 
literature  is  anecdotal  and  prescriptive. 
Two  studies  illustrate  some  issues  that 
arise  when  organizations  attempt  to  im¬ 
plement  “lessons  learned”  through  the 
adoption  of  groupware  systems. 

Orlikowski  (1993)  studied  an  account¬ 
ing  firm,  Alpha  Consulting,  which  adopted 
Lotus  Notes,  a  documentary  support  sys¬ 
tem  with  hulle- 
tin  hoard,  post¬ 
ing,  discussion 
group,  and  elec¬ 
tronic  mail  ca- 
pahilities.  Al¬ 
pha’s  leaders 
were  concerned 
that  its  consult¬ 
ants,  spread  among  different  offices  across 
North  America,  were  working  on  similar 
problems  but  not  sharing  their  expertise. 
They  hoped  that  Notes  would  provide  a 
system  for  storage  and  sharing  of  solutions 
to  a  variety  of  problems. 

Alpha’s  junior  consultants  used  Notes 
infrequently.  They  seemed  uninterested  in 
learning  how  to  use  the  program  and  gave 
up  easily  when  faced  with  frustrations. 
Orlikowski  found  that  the  younger  con¬ 
sultants  had  less  incentive  to  learn  to  use 
the  program.  Their  promotions  were  based 
on  billable  hours  tied  to  client  work,  and 
they  could  not  justify  billing  clients  for 
the  time  it  took  them  to  learn  this  new 
system.  Also,  they  did  not  understand 
potential  applications  of  Notes  in  their 
work. 


Senior  consultants,  on  the  other  hand, 
used  Notes  more  often.  Because  they  had 
job  security  they  were  more  willing  to 
invest  time  to  explore  and  experiment  with 
Notes.  Because  of  their  experience,  they 
were  able  to  see  how  the  system  would 
benefit  their  work. 

Another  group  of  tax  consultants  in 
Washington,  DC,  adopted  the  Notes  pro¬ 
gram.  The  study  suggests  that  they  had 
significant  incentive  to  show  that  they 
were  visible  and  valuable  within  the  firm, 
and  using  Notes  was  an  opportunity  to 
broadcast  their  visibility,  to  electronically 
publish  their  advice  and  make  it  available 
to  many  of  the  consultants  around  the  firm. 
Their  motivation  was  to  show  that  the 
Washington  office  was  an  important  part 
of  the  firm.  Orlikowski ’s  conclusion  is  that 
organizational  incentive  systems  need  to 
be  taken  into  account  when  adopting 
information  systems. 

Davenport  (1997c)  documents  how 
another  large  consulting  firm  (Ernst  & 
Young)  successfully  adopted  a  Notes 
program.  They  created  a  miniorganization 
(the  Center  for  Business  Knowledge)  that 
organized  Ernst  &  Young’s  consultants 
into  specific  areas.  This  organization  was 
stalfed  with  consultants  from  other  offices, 
who  were  given  6-month  assignments  to 
play  a  special  role  as  “knowledge  net- 
workers.”  Within  a  short  time,  22  networks 
of  consultants  with  expertise  in  certain 
industries  and  technology  sectors  were  in 
place.  Each  network  was  assigned  a  half¬ 
time  person  who  codified  the  Notes  data¬ 
bases,  organized  the  insights  from  differ¬ 
ent  projects,  prompted  line  consultants  to 
add  their  own  insights,  and  edited  the 
project’s  discussion  and  document  data¬ 
bases.  These  knowledge  networkers  came 
to  understand  consultants’  needs  and 
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topics  very  well.  Because  the  knowledge 
networkers  were  on  short-term  assign¬ 
ments,  they  were  expected  to  use  this  new 
expertise  to  advance  their  careers  when 
they  returned  to  their  consulting  positions. 

Taken  together,  these  studies  suggest 
that  it  is  important  to  pay  attention  to  the 
social  context  in  which  people  use  infor¬ 
mation  technology,  as  well  as  the  particu¬ 
lar  incentive  systems  for  knowledge  trans¬ 
fer.  The  groups  in  Alpha  Consulting  and 
Ernst  &  Young  had  different  incentives  to 
share  information,  and  their  respective 
outcomes  were  different.  An  aspect  cen¬ 
tral  to  the  second  case  is  the  presence  of  a 
group  that  facilitates  the  learning  process. 
It  is  notable  that  this  group  came  from  the 
very  consultant  group  for  whom  the  pro¬ 
gram  was  designed.  They  were  able  to 
bring  field  expertise  to  bear,  and  were  able 
to  build  ongoing  relationships  in  the  field 
to  prompt  users  to  contribute.  They  be¬ 
came  familiar  with  the  dilemmas  and  chal¬ 
lenges  in  the  field  and  were  able  to  guide 
the  users  to  various  resources  in  the 
program. 

These  studies  reflect  issues  mentioned 
earlier,  particularly  issues  of  motivation, 
which  inhibit  use  of  LLSs.  Other  barriers 
such  as  low  priority,  resistance  to  change, 
lack  of  commitment,  and  turf  protection 
are  also  cited.  However,  another  study  of 
knowledge  transfer  offers  a  somewhat 
different  perspective.  Szulanski  (1996) 
studied  the  phenomenon  of  “knowledge 
stickiness,”  the  extent  to  which  problem¬ 
atic  situations  are  experienced  during 
knowledge  transfer.  He  found  that  the  pri¬ 
mary  obstacles  to  transfer  of  best  practices 
in  organizations  are  (1)  lack  of  absorptive 
capacity,  which  refers  to  the  ability  of  the 
recipient  to  identify,  value,  and  apply  new 
knowledge;  (2)  causal  ambiguity,  or  the 


uncertainty  regarding  cause-effect  rela¬ 
tionships  on  the  part  of  the  knowledge 
recipient;  and  (3)  arduous  relationship 
between  the  source  and  recipient,  which 
is  described  by  the  degree  to  which  the 
relationship  serves  as  a  conduit  for  knowl¬ 
edge  and  the  degree  of  communication  and 
intimacy  in  the  relationship  between  the 
source  and  the  recipient.  This  suggests  the 
benefits  of  attention  to  aspects  of  organi¬ 
zational  culture,  such  as  developing  the 
learning  capacities  of  organizational  units, 
fostering  closer  relationships  between 
units,  and  understanding  more  systemati¬ 
cally  the  practices  and  learning  readiness 
of  organizational  units. 

Much  studying  remains  to  be  done. 
Some  factors  have  received  little  or  no  at¬ 
tention  by  researchers  of  organizational 
learning  and  knowledge  management.  For 
example,  much  of  the  knowledge  manage¬ 
ment  literature  relies  on  cases  from  private 
sector  firms,  and  so  unique  aspects  of  pub¬ 
lic  organiza¬ 
tions  may  have 
been  neglected. 

Private  firms 
typically  have 
clearer  goals, 
such  as  market 
share  and  prof¬ 
itability,  than 
public  organiza¬ 
tions.  Indeed,  the  knowledge  management 
systems  for  private  firms  are  often 
“closed”  and  unavailable  to  outsiders  so 
that  the  firms  can  protect  their  knowledge 
and  learning  to  achieve  a  competitive  edge. 
Public  organizations,  particularly  large 
ones,  have  less  clear-cut  goals  and  perhaps 
even  conflicting  and  competing  goals 
among  their  constituent  elements. 
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Clearly,  a  level  of  competition  exists 
within  the  Department  of  Defense  (DoD) 
among  the  services,  programs,  and  depots, 
test  centers,  and  smaller  organizations 
(Kronenherg,  1990).  It  seems  likely  then 
that  such  competition  could  adversely  af¬ 
fect  the  nature  and  extent  of  participation 
in  an  LLS  that  spanned  several  acquisi¬ 
tion  organizations.  Conversely,  competi¬ 
tion  might  promote  participation  in  a 
“closed”  LLS  within  an  organization.  Such 
effects  could  he  manifested  more  widely 
in  DoD’s  current  policy  drive  to  become 
more  “husiness-like”  in  its  operations. 

Implications 


The  literature  reviewed  in  this  article 
indicates  that  organizational  characteristics 
and  issues  have  at  least  as  much,  and 
perhaps  more,  importance  than  informa¬ 
tion  technology  issues  in  knowledge  trans¬ 
fer.  A  key  first  step  in  LLS  design,  then,  is 
to  specify  the  organization  for  which  the 


system  will  he  designed.  This  is  especially 
critical  in  regard  to  defense  acquisition  or¬ 
ganizations,  which  vary  in  many  respects. 
One  could  design  an  acquisition  LLS  for 
the  entire  DoD;  for  any  of  the  services; 
for  a  major  command  such  as  Army 
Material  Command;  for  one  of  its  subor¬ 
dinate  commands  such  as  Aviation  and 
Missile  Command;  or  for  a  local  organi¬ 
zation,  such  as  a  lab,  test  range,  or  engi¬ 
neering  center.  One  also  could  design  an 
LLS  within  any  of  these  organizations  for 
a  particular  specialty  or  acquisition  career 
field,  such  as  contracting,  cost  estimation, 
or  program  management.  Clearly,  learn¬ 
ing  will  occur  in  different  ways  among 
members  of  these  various  organizations 
according  to  whether  their  relationships 
are  strongly  or  weakly  tied,  the  organiza¬ 
tions’  interpretive  contexts,  and  many 
other  factors. 

Table  2  shows  how  organizations  might 
vary  according  to  some  factors  addressed 
in  this  article,  which  would  affect  design 
of  acquisition  LLSs.  Design  may  be  most 


Table  2.  Variations  in  Organizational  Farters  in 
Arquisitien  Lessens-Learnetl  System  Design 


Organization 

Ties 

interpretive 

Context 

Organizationai 

Goais 

DoD® 

Weak 

Low 

Ambiguous/conflicting 

Career  field  across  DoD® 
(e.g.,  all  systems 
engineers) 

Weak 

High 

Ambiguous/conflicting 

Service 

Weak 

Moderate 

Possibly  mixed 

Major  command 

Weak 

Moderate 

Possibly  mixed 

Subordinate  comand 

Moderate 

Moderate 

Clear 

Local  organization 

Strong 

High 

Clear 

®  DoD,  Department  of  Defense 
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problematic  for  a  DoD-wide  system.  Be¬ 
cause  most  DoD  members  have  weak  ties 
(i.e.,  distant,  infrequent,  or  nonexistent 
relationships)  and  low  interpretive  context 
(e.g.,  due  to  dissimilar  backgrounds),  a 
system  targeted  towards  sharing  of  explicit 
and  codified  versions  of  lessons  learned 
would  seem  most  appropriate.  However, 
possibilities  of  competition  among  DoD 
organizations  may  inhibit  participation  in 
such  a  system.  Members  of  an  acquisition 
specialty  or  career  field  in  DoD  share  a 
higher  interpretive  context,  which  signals 
greater  potential  for  lesson  sharing.  To  the 
extent  members  of  the  same  field  share  a 
professional  loyalty  to  their  field  over  loy¬ 
alty  to  their  organizations,  some  of  the 
deleterious  effects  of  competition  may  be 
mitigated.  Members  of  the  services  and  of 
major  commands  have  weak  ties,  though 
interpretive  context  in  these  organizations 
is  certainly  higher  than  that  of  DoD.  Or¬ 
ganizational  competition  may  yet  exist  at 
these  levels,  particularly  for  scarce  fiscal 
resources.  Sharing  of  tacit  and  complex 
lessons  would  be,  as  expected,  most 
effective  in  subordinate  commands  and 
local  organizations. 

Such  variation  points  out  the  need  for 
contingency  approaches  in  LLS  design. 
Achieving  effective  knowledge  transfer 
between  members  of  the  acquisition  com¬ 
munity  will  require  substantial  investment 
of  time  and  resources  in  determining  what 
kind  of  knowledge  is  appropriate  for  dif¬ 
ferent  groups  based  on  their  relational 
histories  and  contexts. 

An  important  question  regarding  LLSs 
is  the  possibility  of  creating  a  community 
of  practice  when  members’  connections 
are  virtual  rather  than  face-to-face.  Virtual 
communities  lack  the  synchronic  feedback 
and  reciprocal  exchange  characteristic  of 


a  discourse  that  creates  and  reflects  a 
shared  history.  Transfer  of  tacit,  complex 
knowledge  requires  a  great  deal  of  infor¬ 
mal,  face-to-face  contact.  Thus,  if  an  or¬ 
ganization  relies  on  weak  links  such  as 
intranets  to  exchange  complex,  tacit 
knowledge,  it  will  likely  meet  with  little 
success. 

True  communities  of  practice  are  prob¬ 
ably  not  possible  in  larger  organizations 
where  members  are  weakly  tied  and  inter¬ 
pretive  context  is  low.  In  such  organiza¬ 
tions,  members  are  more  likely  to  search 
for  novel  information  in  explicit  and  codi¬ 
fied  lessons. 

Thus,  leaders  of 
larger  organiza¬ 
tions  should  fo¬ 
cus  their  efforts 
on  eliminating 
barriers  to  and 
encouraging 
members’  par¬ 
ticipation  in 
systems  that  tar¬ 
get  such  lessons.  Davenport’s  findings 
(1997c)  may  be  especially  significant  in 
this  regard.  Leaders  of  larger  acquisition 
organizations  may  consider  assigning  tem¬ 
porary  duty  to  “knowledge  networkers,” 
who  would  actively  seek  lessons,  map  out 
knowledge  needs,  encourage  inquiry,  and 
make  connections  among  members. 

When  members  of  an  organization 
share  strong  ties,  close  proximity,  and 
frequent  interaction,  complex  and  tacit 
knowledge  will  be  easier  to  transfer.  How¬ 
ever,  explicit  knowledge  may  be  redun¬ 
dant.  If  attempts  are  made  to  transfer  ex¬ 
plicit  knowledge  between  strongly  tied 
members,  they  might  lose  interest  in  the 
LLS.  Thus,  leaders  of  smaller  organiza¬ 
tions  should  emphasize  strong  ties  among 


"True  communities 
of  practice  are 
prebabiy  net  pes- 
sibie  in  larger  orga¬ 
nizations  where 
members  are  weakly 
tied  and  interpretive 
context  is  low." 
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members,  creation  of  a  high  interpretive 
context,  and  establishment  of  clear  goals 
to  maintain  an  environment  that  facilitates 


sharing  of  complex  and  tacit  lessons 
among  members  of  a  true  community  of 
practice. 
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